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(54) Tape drive data buffering 

(57) A tape storage device (26) is used in conjunc- 
tion with a host computer (10) to archive data. The stor- 
age device (26) has interface logic (36) that buffers 
blocks of data from the host computer (10) In a memory 
buffer (46). The interface logic (36) processes data as 
the data is received to create a processed data block 
that is smaller in size than the original, unprocessed 
data block While receiving elements of the data block, 
the interface logic (36) repeatedly determines the 
amount of free memory in the memory buffer (46), and 
temporarily suspends the block transfer whenever the 
amount of free memory falls below a predetermined 
threshold. The block transfer is resumed when the 
amount of free memory becomes equal to or greater 
than the threshold. This utilizes nearly all available 
memory, while preventing buffer overflow, without any 
need to perform complex calculations to predict the size 
of the data block after processing. 
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Description 

TECHNICAL FIELD 

[0001 ] The invention relates to tape storage devices 
and to methods of processing and transferring block of 
data to such tape storage devices. 

BACKGROUND OF THE INVENTION 

[0002] It is common for a host computer to archive 
data on a linear tape storage device or medium. The 
characteristics of linear tape storage devices generally 
require that data be provided at a fixed rate that is 
related to the linear speed of the tape medium itself. In 
most cases, electronic interface logic is associated with 
a tape drive in order to accept data at a rate more con- 
venient for the host computer, and to then format the 
data appropriately for the tape writing mechanisms. In 
addition, the interface logic processes the data in vari- 
ous way. such as by compressing the data. 
[0003] It is conventional for the host computer to 
break data into relatively large data blocks, and to pro- 
vide such data blocks as integral packages of data to 
the tape drive interface logic. This is done for the sake 
of efficiency. Rather than making intermittent small data 
transfers at a rate set by the tape device, the host com- 
puter is allowed to make larger block transfers at less 
frequent intervals but at higher data rates, thereby free- 
ing the intervening time for other tasks. Block size is 
normally established by the host computer. The primary 
purpose of the interlace logic is to buffer the data blocks 
as they are received, to process the data blocks (such 
as by compressing them), and to write the resulting data 
t)lock elements to the tape medium at the rate required 
by the tape medium. 

[0004] The interface logic normally includes a mem- 
ory t>uffer for incoming data. The buffer is used to syn- 
chronize data transfers from the host computer to the 
tape drive. By using a buffer, the interface logic can 
accept blocks of data at high data rates from the host 
conputer, and then write the data to the tape device at 
the slower rate required by the tape device. 
[0005] Before accepting a data block from the host 
computer, the interface logic determines whether there 
is enough buffer memory to hold the data block. How- 
ever, because of compression and other processing 
performed by the interface logic, it is often difficult to 
determine the amount of buffer space that will be 
needed for a particular data block after it has been proc- 
essed. When beginning a block transfer, the host com- 
puter indicates the size of the unprocessed block. 
However, complex calculations might be required to 
determine the size of the block after processing. There 
are known ways to overcome this problem. 
[0006] One way is to actually calculate the size of 
the processed data, based on the size of the incoming 
unprocessed data block, prior to allowing the block 



transfer to l^egin. The disadvantage of this method is 
that it requires complex software algorithms or ecpen- 
sive custom hardware to perform the calculations. 
[0007] Another way is to conservatively 

5 approximate the size of the processed data, avoiding 
the complex calculations noted above. This method, 
however, tends to waste buffer memory due to the con- 
servative nature of the approximations. 
[0008] A third way is to use two memory buffers. 

10 Incoming blocks are stored, without processing, in a first 
buffer. Once a block is stored in the first buffer, it is proc- 
essed and written to a second buffer, prior to writing to 
the tape itsell This method has the obvious disadvan- 
tage of requiring much more memory than the previous 

IS two methods. 

NUMMARY OF THE INVENTION 

[0009] In accordance with the invention, a single 

20 buffer is used by tape drive interface logic to buffer 
incoming data blocks. Data is processed as it is 
received from the host computer and is then stored in 
the buffer. The interface logic monitors the amount of 
available buffer memory (which decreases as data is 

25 received and increases as data is written to tape). When 
the amount of free memory drops below a predeter- 
mined threshold, the block transfer is tenrporarily halted. 
When more memory becomes available, and the 
amount of free memory rises above the threshotol. the 

30 block transfer is resumed. The use of a non-zero thresh- 
old eliminates buffer overruns that might othenvise 
result from data that has been accepted from the conrv 
puter, but that has not yet been buffered. The threshoM 
is calculated to always leave room for the maximum 

35 possible amount of such "in-transit" data. 

DESCRIPTION OF THE D RAWINGS 
[0010] 

40 

Fig. 1 is a block diagram of a computer system in 
accordance with the invention. 
Fig. 2 is a block diagram of a tape drive system in 
accordance with the invention. 
45 Rg. 3 is a flowchart illustrating prefenred steps in 
accordance with the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

50 [0011] Fig. 1 shows a computer system 10 in 
accordance with the invention. Computer system 10 
includes a microprocessor 12 and associated memory 
1 4. It also includes various peripheral interfaces such as 
a video adapter 16, a serial port 18. a parallel printer 

55 port 20, a keyt>oard interface 22, and other interfaces 
not shown. The system also includes a SCSI (small 
computer system interface) interface 23 for connection 
to various different peripherals such as a hard disk 24 
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and a tape drive 26. The SCSI interface might also be 
used for connecting different devices such as CD-ROM 
and DVD devices. The SCSI interface is defined by a 
well-known standard, and is used in many desktop com- 
puters. 5 

[0012] , Fig. 2 shows pertinent components of tape 
drive 26 in block form, including a tape transport mech- 
anism 30, a read/write head mechanism 32. a SCSI 
interiiace 34, and interface logic 36 that provides a logi- 
cal interface between host computer 10 and the tape io 
writing mechanisms 30 and 32 of tape drive 26. Inter- 
face logic 36 can be formed by programmable compo- 
nents that retrieve and process instructions from 
memory, or by fixed-logic components that are intercon- 
nected to provide the functionality described below. Fur- is 
thermore, interface logic 36 and its functions can be 
implemented by a combination of different types of togi- 
cal components, including components that are com- 
monly refered to as software, hardware, and firmware. 
[0013] For purposes of illustration, interface logic 20 
36 is shown as being comprised of a programmable 
microprocessor or microcontroller 40 in conjunction with 
addressable memory components 42 and I/O circuits 
44. The memory components 42 include both non-vola- 
tile memory (such as ROM or EPROM) and volatile 25 
memory (such as some type of RAM). The addressable 
memory components 42 store a program. The program 
has instructions that are retrieved and executed by 
microprocessor 40. The interface logic is configured to 
implement conventional functions, including functions 30 
for reading and writing a tape and for transferring data 
over SCSI interface 34. 

[0014] As shown in Fig. 2, the interface logic 
includes a data txiffar 46. Although shown separately for 
purposes of discussion, this data buffer might be a part 3S 
of memory 42. The data buffer is used to buffer data 
received from host computer system 10. before the data 
is written to tape, and to synchronize the processes of 
receiving data from the host computer and writing the 
dafa to tape. 40 
[0015] Fig. 3 illustrates a method, in accorclance 
with the invention, for processing and buffering data 
blocks prior to storing them on the tape storage device. 
A step 100 comprises Initiating a block transfer of an 
unprocessed data block from host computer 1 0. In most 4s 
steps, the transfer is initiated by host computer 10. The 
unprocessed data block contains unprocessed data 
bytes, words, or elements that are transferred in 
sequence during the block transfer. The unprocessed 
data block has a size that is defined by the host compu- so 
ter. 

[001 6] A subsequent step 1 02 comprises determin- 
ing the amount of free memory in buffer 46. That is. the 
interface logic determines how much buffer memory is 
available for storage of incoming date. In addition, this ss 
step includes comparing the amount of free buffer mem- 
ory with a predetermined memory threshold. If the 
amount of free memory is less than the predetermined 



threshold, step 102 is repeated until the amount of free 
memory rises above the threshold. In practice, this rep- 
resents a step of temporarily suspending the block 
transfer whenever the amount of free memory in the 
memory buffer falls below the threshold, and a subse- 
quent step of resuming the block transfer whenever the 
amount of free memory in the memory buffer is not 
below the first predetermined threshold. Such suspen- 
sion and resunrption of a block transfer is accomplished 
using sfandard SCSI protocols. 
[0017] The threshold is calculated to account for 
data elements that have been received from the host 
computer but that have not yet been stored in the mem- 
ory buffer. Thus, the threshold prevents buffer overflow 
that might othenwise result from date that has been 
accepted from the host computer, but that is still "in- 
transrt** In-transit date elements are date elements that 
are being processed but that have not been stored in 
buffer 46. It is generally possible to pre-calculate the 
maximum number of data elements that can be in-tran- 
sit at any given time, for a given logic design. In the 
described embodiment of the inventfon. the memory 
threshold is set equal to or slightly greater than this 
maximum number. 

[0018] Dual thresholds can advantegeously be 
used to increase efficiency of date transfer. For exam- 
ple, a first threshold is used when determining whether 
to suspend a cun^ent biock transfer, and a second, 
higher threshold is used when determining whether to 
resume the block transfer. 

[0019] Whenever the comparison of step 102 indi- 
cates that the amount of free memory is not below the 
predetermined threshold, step 104 is performed of 
receiving and processing one or more date elemente 
from the incoming data block to create processed date 
elements. Step 104 further includes storing the proc- 
essed date elements In memory buffer 46. 
[0020] When such processing is complete for a par- 
ticular date block, the processed date elements form a 
processed date block in memory buffer 46 having a size 
that is different, (usually smaller) than the size of the 
received unprocessed date block. Processing includes 
compression steps and other steps to ready the date for 
eventual writing to a tape medium. Thus, processing is 
often performed on a group of date elemente, so that 
there is not a one-to-one correspondence between 
incoming date elemente and the actual processed date 
elemerrts written to the memory buffer. Thus, step 104 
might involve receiving a number of unprocessed date 
elemente before writing any processed data elemente to 
the memory buffer 46. 

[0021] Step 1 06 comprises checking whether all of 
the unprocessed date block has been received and 
processed. If rt has not, execution reverte back to step 
102 of checking available memory. Thus, step 102 is 
performed repeatedly while performing the processing 
and storing steps, to monitor the amount of available 
memory and to suspend a block transfer whenever 
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available memory is low. If the result of step 106 is true, 
the process of receiving and buffering a data block is 
complete. 

[0022] The interface logic also performs a step of 
writing or transfening processed data blocks to the tape 
storage mechanisms of the tape drive. This step is per- 
formed either while receiving the data block or after the 
data block has been completely buffered, depending on 
implementation details. 

[0023] The described invention allows efficient use 
of tape drive buffer memory, without complex calculation 
and their associated hardware or software overhead. 
[0024] The invention has been described in lan- 
guage specific to structural features and/or methodolog- 
ical steps. It is to be understood, however, that the 
invention defined in the appended claims is not neces- 
sarily limited to the specific features or steps described 
above. Rather, the specific features and steps are dis- 
closed as exemplary forms of implementing the claimed 
invention. 

Claims 

1. A method of processing and buffering data blocks 
prior to storing them on a tape storage medium, 
each data block containing unprocessed data ele- 
ments that are transferred in sequence during a 
block transfer from a host computer (10), compris- 
ing the following steps: 

initiating a block transfer of an unprocessed 
data block from a host computer (10). the data 
biodK having a first size; 
processing the data block as it is received from 
the host computer to create processed data 
elements that form processed data blocK the 
processed data t>lock having a second size that 
is different from the first size; 
storing the processed data elements in a mem- 
ory buffer (46) as they are aeated: 
while performing the processing and storing 
steps, repeatedly determining an amount of 
free memory in the memory buffer (46); 
temporarily suspending the block transfer 
whenever the amount of free memory in the 
memory buffer (46) Is below a first predeter- 
mined threshoki; 

writing the processed data tHock from the 
memory buffer (46) to the tape storage 
medium. 

2. A method as recited in claim 1 , further comprising a 
step of calculating the predetermined threshold to 
account for data elements that have been received 
from the host computer (10) but that have not yet 
been stored in the memory buffer (46). 

3. A method as recited in claim 1 , wherein a data ele- 



ment is defined as being in-transit when it has been 
received from the host computer (10) but has not 
yet been stored in the memory buffer (46). and 
wherein there is a known maximum number of data 
5 elements that can be in-transit at any given time, 

the method further comprising a step of calculating 
the predetermined threshold to account for the 
msudmum number off in-transit data elements. 

10 4. A method as recited in daim 1 . comprising a further 
step of resuming the block transfer whenever the 
amount of free memory in the memory buffer (46) is 
not below the first predetermined threshold. 

IS 5. A method as recited In daim 1 , wherein a data ele- 
ment is defined as being in-transit when it has been 
received from the host computer (10) but has not 
yet been stored in the memory buffer (46). and 
wherein there is a known maximum number of data 

20 elements that can be in-transit at any given time, 
the method further comprising: 

calculating the predetermined threshold to 
account for the maximum number of in-transit 
25 data elements; 

resuming the block transfer whenever the 
amount of free memory in the memory buffer 
(46) is not below the first predetermined thresh- 
old. 

30 

6. A method as recited in daim 1 . comprising a further 
step of resuming the block transfer whenever the 
amount of free memory in the memory buffer (46) is 
not above a second predetermined threshold, the 

35 second predetermined threshold being greater than 
the first predetermined threshold. 

7. A method as redted in claim 1, wherein the 
processing step comprises compressing the data 

40 block. 

8. A tape storage device (26) for use in conjunction 
with a host computer (10), the tape storage device 
(26) comprising: 



a tape writing mechanism (32); 
. interface logic (36) between the host computer 
(10) and the tape writing mechanism (32): 
a memory buffer (46); 
50 the internee logic (36) k>eing configured to per- 

form steps comprising: 

accepting a request for a block transfer of an 
unprocessed data block from a host compu- 
ter(IO). the unprocessed data block having a 
55 first size; 

receiving the unprocessed data block from the 
host computer (10); 

processing the unprocessed data kslock as it is 
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received from the host computer (10) to create 
processed data elements that form a proc- 
essed data btocK the processed data block 
having a second size that is different from the 

first size; 5 

storing the> processed data elements in the 
memory buffer (46) as they are created: 
while performing the processing and storing 
steps, repeatedly determining an amount of 
free memory in the memory buffer (46): 
temporarily suspending the block transfer 
whenever the amount of free memory in the 
memory buffer (46) is below a first predeter- 
mined threshold: 

transferring the processed data block from the is 
memory buffer (46) to the tape writing mecha- 
nism. 

9. A tape storage device as recited in claim 8. 
wherein: 20 

a data element is defined as being in-transit 
when it has been received from the host com- 
puter (10) but has not yet been stored in the 
memory buffer (46) ; 25 
there is a known maximum number of data ele- 
ments that can be in-transit at any given time; 
the predetermined threshold is calculated to 
account fa the maximum number of in-transit 
data elements. 30 

10. A tape storage device as recited in daim 8. 
wherein: 

a data element is defined as being in-transit 35 
when it has been received from the host com- 
puter (10) but has not yet been stored in the 
memory buffer (46); 

there is a known maximum number of data ele- 
ments that can be in-transit at any given time; 40 
the predetermined threshold is calculated to 
account for the maximum number of in-transit 
data elements. 

the interface logic is configured to perform a 
further step comprising resuming the block 45 
transfer whenever the amount of free menrrary 
in the memory tMiffer (46) is not below the first 
predetermined threshold. 
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